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POLLING SYSTEMS WITH PARAMETER REGENERATION, 
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and Universidade de Sao Paulo 

We consider a polling model with multiple stations, each with 
Poisson arrivals and a queue of infinite capacity. The service regime 
is exhaustive and there is Jacksonian feedback of served customers. 
What is new here is that when the server comes to a station it chooses 
the service rate and the feedback parameters at random; these remain 
valid during the whole stay of the server at that station. We give cri- 
teria for recurrence, transience and existence of the sth moment of 
the return time to the empty state for this model. This paper gener- 
alizes the model, when only two stations accept arriving jobs, which 
was considered in [Ann. Appl. Probab. 17 (2007) 1447-1473]. Our 
results are stated in terms of Lyapunov exponents for random matri- 
ces. From the recurrence criteria it can be seen that the polling model 
with parameter regeneration can exhibit the unusual phenomenon of 
null recurrence over a thick region of parameter space. 

1. Introduction. There is a large literature, for example, [1, 7, 9, 12, 
14, 15] on polling systems, that is, systems with a single moving server and 
multiple stations where queues form. Systems of this kind arise frequently in 
production or computer networks (e.g., consider the situation when a single 
processing unit has to deal with job requests coming from several terminals). 
We consider a polling system where the queues at stations can be arbitrarily 
long and the service regime is exhaustive, that is, the server does not leave 
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a station until the queue there is empty. Also, customers can move from one 
queue to another one before definitively leaving the system. What is new 
here and in [11] is that we allow a randomly selected service regime each 
time the server visits a station. Throughout the paper we use service regime 
to mean the set of service and feedback parameters currently in use; in other 
words, we are working with models where those parameters are (randomly) 
updated each time the server goes to another station. It is worth mention- 
ing that normally in the polling literature arrival and service parameters 
are fixed, and our main purpose here is to explore new phenomena which 
appear when one allows them to be randomly updated. We mention also the 
related work [3], where a single server queue with two possible regimes was 
considered. One of the results of [3] is that the asymptotic behavior of the 
process is very different when the slow service rate is less than the arrival 
rate of jobs than when it is faster than the arrival rate. This seems to be 
very natural from our point of view; cf. Theorem 1.1 and Corollary 1.1. 

This paper presents results for a generalization of the model studied 
in [11]. The model considered there is essentially two dimensional, while 
here we consider any number of stations. The reason for splitting this work 
into two separate papers, depending on whether two or more stations re- 
ceive jobs, is that in the former case the stability conditions are expressible 
in terms of explicitly determined factors, while in the latter, they are ex- 
pressible in terms of factors whose existence is shown but whose values are 
inaccessible to direct computation. These factors are reminiscent of the Lya- 
punov exponents for products of random matrices whose values usually can 
be approximated only by stochastic simulation. 

The model in [11] includes general service time and switching time dis- 
tributions. With more than two stations the model and its analysis become 
considerably more complex, so in this paper we discuss exponential ser- 
vice times, zero switching times and a cyclic server routing scheme to help 
simplify the discussion. Within this setup, the results of the present paper 
generalize those of [11] and the proofs differ substantially in detail as well. 

It seems to us that queueing models in which parameters are randomly 
reset are a very natural generalization of standard queueing models. How- 
ever, stability investigations for such models seem to require quite deep 
mathematical techniques as these models can exhibit new phenomena. In 
particular, our polling model can have a "thick" region of null recurrence 
and even in ergodic cases the return time to the empty state may have only 
polynomial moments. This implies that convergence to equilibrium cannot 
occur at exponential rate. 

1.1. The model. Consider the following continuous time model: there 
are d + 1 nodes (stations) indexed by n € := {0, . . . , d}, each one has 
its own infinite capacity queue. Customers arrive at the queue of station n 
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according to a Poisson point process with rate A n > 0, independently of 
all other events, n = 0, . . . , d. A single server visits the stations in cyclic 
order (0 — > 1 — ^ • • • — ^ d — — > • • •) starting at station 0. At each station the 
server adopts the exhaustive serving policy: it serves all the customers that 
were queueing at the station when the server arrived there together with 
all subsequent arrivals up until the queue first becomes empty and then 
instantly jumps to the next station. Every served customer either leaves the 
system or is transferred to another queue, with given probabilities. Each 
time the server arrives at a station, it chooses randomly a serving rate and 
feedback (transition) probabilities; those parameters remain valid during the 
stay of the server at that station. 

To make the last sentence rigorous, we have to make some definitions. 
Abbreviating (fj,,ji, . . . ,j d ) by (m,7), define 

M = |(/i,7) :/J. > 0,7i > for all i, and ^7, < 1 j C R d+1 . 

Let v n , n = 0, . . . , d, be d+ 1 probability measures on A4. Denote also [k] := 
kmod(d + 1) £ l^d+i- Then, we complete the description of the model as 
follows: every time the server comes to station n we choose a random element 
(/x,7) G M. according to u n , independently of everything else. For the period 
while the server performs this batch of services, the service times are i.i.d. 
and exponentially distributed with parameter /i. Each served customer either 
goes to station [n + k] with probability 7^ for k = 0, . . . , d or leaves the system 
with probability 1 — 71 — • • • — 7^, independently of other events. Also, for 
definiteness we assume that the server just waits somewhere (say, at some 
special place 6) when there are no customers in the system (but when the 
first customer arrives, the server instantaneously jumps to the corresponding 
station). 

Throughout this paper, and often without recalling it explicitly, we sup- 
pose that the (uniform ellipticity) condition below is fulfilled: 

Condition E. 

(i) There exists Eq > such that, for all n = 0, . . . , d, 

v n [(n,j):/j,> \ n + e ] = 1- 

(ii) There exists Mq such that, for all n = 0, . . . , d, 

v n [{jjt,i):/jt<M ] = l. 

Part (i) of the above condition guarantees that the server cannot get stuck 
in a single station. Part (ii) is just a technical assumption [using a simple 
monotonicity argument, one can show that this assumption is not necessary 
for proving parts (ii) and (iii) of Theorem 1 . 1 below] . 
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1.2. The main result. Assuming that the process starts from some fixed 
and nonempty initial configuration (and initially the server is at station 0), 
we define r as the first moment when there are no customers in the system 
(i.e., r is the time of reaching the zero configuration). 

To formulate our result, we need to introduce certain random matrices. 



For n£{0,...,d}, let 



\ a ij h,j=o 



a 



(n) _ 

1, k 



... d— l be a matrix defined as follows: 

fc+il + 7fc+i^ 



k = 0, . . . , d — 1, = 1, k = 0, . . . , d 

where (/U,7) ~ v n . That is, 

I A [w+1] + 7i/x 
A* - A„ 

A [n+3 ] + 

^ - A„ 

+ld-lH 

A* - A„ 

A[n+d] + 7dA* 

V 



(1.1) 



An 

-2, 

1 






and a^j 1 











for all other i,j, 

o^ 










V - An 

Let A = A^ . . . A^ , where A^°\ . . . , A^ d ' defined above are independent ran- 
dom matrices. Throughout the paper, we suppose that the random matrix A 
is really random, that is, one cannot find a deterministic matrix B such that 
A = B a.s. (this means, in fact, that in at least one node there is randomness 
with respect to the choice of the regime). 

Remarks. 

• The motivation for the definitions of the random matrices A^" 1 ' and A is 
given in the arguments leading to (2.9) below. Very briefly, for any given 
queue length vector x, the random vector Ax gives the probable queue 
lengths after the server has completed a cycle of visits to all stations (a 
random vector because the service rates and feedback probabilities are 
random) . 

• This random matrix A plays a role similar to the matrix M{s) used in 
our previous paper [11], but there are important differences. M(s) is only 
a matrix in [11] because we permit Markov switching of the server there. 
With the cyclic server route assumed in this paper, M(s) would reduce 
to a single random variable, which is why we are able to state our criteria 
there in terms of deterministic parameters. 



POLLING SYSTEMS WITH PARAMETER REGENERATION 5 



In the following few lines we introduce the main classification parameter. 
Let A\, A2, A3, . . . be a sequence of independent random matrices, each one 
having the same distribution as A. Define for any s > 

(1.2) k(s) = lim Q {E\\A n ...A l \\ s ) 1 / n 

(unless otherwise stated, all norms we use in this paper are £i-norms). As 
shown below, this limit always exists by submultiplicativity of the norm. 
Indeed, let I={s£ M:E||A|| S < 00}. Observe that Condition 1.1 guarantees 
that [0, 00) C I. 

Since the map A 1— > \\A\\ is submultiplicative, k n (s) = E||A n . . . Ai\\ s satis- 
fies k n+m (s) < k n (s)k m (s), hence, lim n lQ gM s ) _ log k(s) exists on /. 

If si,S2 € / with si < S2, then the whole segment [si,S2] £j I. For any 
t G (0, 1), by the Holder inequality with p=l/t and g = 1/(1 — t), we have 

(k n (t Sl + (1 - i)s 2 )) n < E(\\A n . . . A 1 f fa i)VPE(||A» • • • 

This inequality establishes log-convexity of k(s) [and shows also that k(s) is 
continuous]. Also, from the nondegeneracy of the random matrices, it follows 
that k(s) is nonconstant. Furthermore, k'(0) is the top Lyapunov exponent 
of A. 

The main classification parameter is 

(1.3) s = inf{s>0:k(s) > 1} 

(by definition, inf = +00). Note that k(0) = 1, and so s = if k'(0) > 0, 
and < so < +00 if k'(0) < 0. The main result of this paper is the following. 

Theorem 1.1. (i) // k'(0) > 0, then P[r = oo] > 0, that is, the process 
is transient. 

(ii) If k'(0) < 0, then P[r = oo] = 0, that is, the process is recurrent. 
(hi) Suppose that < s < sq, then Er s < oo. 
(iv) For s > sq, we have Et s = oo. 

We do not consider the case when k'(0) = 0. There is some discussion of 
the difficulties for the case of two stations in [11]. 

The above theorem shows that, for the model of this paper, the typical 
situation is that geometric ergodicity is absent, and only polynomial mo- 
ments of the return time exist (this corresponds to the case so < oo). We 
now formulate a simple sufficient condition for the finiteness of so- For any 
matrix B, let p(B) be the spectral radius of B [for the case of nonnegative 
matrices, p(B) is the maximal eigenvalue]. We have 

(1.4) F\p(A)>l]>0 => s <oo. 
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Indeed, the fact that ¥[p(A) > 1] > implies, by continuity, that there exist 
e, 5 > and a nonnegative vector y such that \\y\\ = 1 and ¥[Ay > (1 + e)y] > 
5. Then 

E\\A n ...A 1 \\ s >E\\A n ...A 1 y\\ s 
> (l + e) sn 5 n , 

and so we obtain from (1.2) and (1.3) that if s is such that (1 +e) s 5 > 1, 
then so < s. 

The relation (1.4) has a nice interpretation: 

Corollary 1.1. For the absence of geometric ergodicity (i.e., for sq 
to be finite) it is sufficient that there exists a set of possible parameters 
[i.e., (/i,7)„ € suppf n , n = 0, . . . , d] for which the homogeneous model is 
transient. 

Indeed, note that for a nonrandom (and nonnegative) matrix, the loga- 
rithm of the largest eigenvalue equals the top Lyapunov exponent, and so by 
Theorem 1.1 (i) , the model with nonrandom regimes is transient if p{A) > 1. 

Remark. As with the model of [11], the model of this paper can dis- 
play an interesting feature, the existence of a thick null recurrence phase. 
Think about a family of models depending on one (or several) parameter (s). 
Suppose that this family is nicely defined, in such a way that sq is a contin- 
uous function of those parameters, and such that 1 is in the interior of the 
range of values of this function. Then, it is clear that, as we continuously 
change the values of the parameters, there are nondegenerate regions that 
correspond to ergodicity /null recurrence. This kind of behavior is quite rare; 
in particular, when the parameters of the polling system are fixed (say, Aj 
is the arrival rate to station i, pi is the service rate when the server is in 
station i, and there is no feedback), it is known that null recurrence is a 
critical phenomenon which can only occur when J2i \l = 1; see [?]• Only 
a few examples of models having a thick null recurrence phase are known 
(besides [11], see also [5]). For a concrete example which demonstrates this 
situation in the setup of this paper, we refer the reader to Section 2 of [11]. 
The example there has only two stations and so the calculations of the 
required exponents can be done explicitly. Note that, for the case of two 
stations, the models of this paper and of [11] (with exponential services and 
without switching time) are the same. 

1.3. Related problems and generalizations. First, we remark that the 
model with any deterministic and periodic itinerary of the server can be 
studied in exactly the same way as the model of this paper. We decided 
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to focus on the circular itinerary to avoid notational complications. There 
are other interesting routing policies that could be studied, for example, 
Markovian (after finishing the service in node i, the server goes to j with 
probability Py), greedy (the server goes to the largest queue), local greedy 
(the server goes to the queue that is largest among some set of neighbors), 
etc. In this general setting, however, such routing policies cannot be treated 
directly by the methods of this paper, so a modification (or at least a non- 
trivial refinement) of our approach would be necessary. For the case when 
only two stations can receive customers, Markovian routing was considered 
in [11]. 

We believe that the results of this paper remain valid if we allow the 
incoming flow rates to be random as well, updating them to new values 
(independently from the past) at each server switching time [of course, one 
has to require that a condition analogous to Condition 1.1 (ii) holds also 
for the A's]. This leads to a lot more complexity in our proofs but no new 
phenomena, so we have not formulated the model in this way. Further, it 
did not seem very natural to us that switching events should affect the 
incoming rates at the stations which are "far" from the server. A more 
natural model would update the incoming rates only at the stations which 
are "close" to the server (similarly to [11]), but this introduces yet more 
modeling complications. 

There are two other natural ways to generalize the present model: first, 
consider service time with general distributions and second, consider the 
case of nonzero switching time (i.e., when the server empties the queue on a 
station, it takes some time traveling to the next one). With some additional 
assumptions, it is possible to prove that the analogue of Theorem 1.1 remains 
valid. Again, we decided not to describe the present model in this general 
form, because it does not lead to any new phenomena and complicates the 
proofs a lot. 

In the remaining part of this section we describe two other models for 
which our method works. 

Revolver model. This time, consider a model with stationary server and 
moving queues. There are d + 1 locations marked 0, . . . , d and customers 
arrive at location n as a Poisson stream of rate A n . The server is always in 
location and serves the queue using a regime (/i,7) (where \x is the rate 
of service, and 7„ is the probability that a served customer feeds back into 
queue n, n = 1, ...,d). When the queue at location is emptied, all the 
customers in the location i are instantly transferred to i — 1, i = 1, . . . ,d, 
and the server chooses a new regime (^',7') independently of the past and 
according to some probability measure v on M. 

That is, we can visualize this system in the following way: the queues are 
located on a wheel, and when the server finishes the current batch of service, 
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the wheel turns and delivers the next queue to the server. Define [compare 
with (1.1)] 



A' 



I Ai +71// 
H- A 

A2 + 72/t 

pi- Ao 
A3 + 73At 
/^- A 

Ad-i +' 7rf-iM 

/x- Ao 
Ad + 7rf/x 

V /i - A 



10 
10 
1 






o\ 






where (/t,7) ~ Then [with the quantities k(s) and s$ defined as in (1.2) 
and (1.3)] Theorem 1.1 remains valid for the revolver model. This can be 
proved in a similar way to the proof of Theorem 1.1 below (in fact, it is easier 
because in the revolver model the server is always in the same position, and 
so it is not necessary to introduce d + 1 random matrices with different 
distributions). 



Model with a gated service discipline. This is a modification of the model 
defined in Section 1.1, described as follows. Instead of the exhaustive service 
discipline, we consider the so-called gated service discipline (see, e.g., Sec- 
tion 3.2 of [1]): the server only serves the customers that were in the station 
on its arrival, and then proceeds to the next station. The service regime 
can be described by the same set of parameters (/t,7), and here even the 
inclusion of parameter 70 (which corresponds to the probability of sending 
the customer to the same station, but before the gate) makes sense. For this 
model, we still need an ellipticity condition, but in a less restrictive form. 
For gated service, we only need to require that e$ < /i < Mq with probabi- 
lity 1. This is because, when the server arrives at the station, it only needs 
to serve a fixed number of customers (those who were there at the moment 
of arrival), and so, even if it chooses a very small //, the service will be even- 
tually finished, and the server will go to the next station (leaving behind 
the clients that arrived after the start of the service) . 
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For n = 0, . . . , d define the matrices [this time they have size (d+1) x (d + 
1) instead of d x d] 



( A [w+ i] + Tift 



A (n) 



/' 



\n+2] + 72^ 



/' 



A[n+3] + 73M 



V 



<V+cf-l] +7d-l^ 
A[n+d] + 7rfM 

A* 

An +70/" 



1 

1 

1 















1 
1 




where (fi, 7) ~ v n , and let A = A^ . . . A^ , where A^ , . . . , A^ are indepen- 
dent. Again, the method of this paper applies to this model as well, and it 
can be shown that Theorem 1.1 remains valid. 



2. Proof of Theorem 1.1. The remaining part of this paper is organized 
as follows. First, in Section 2.1, we prove two technical lemmas and recall a 
result from [2] that will be used for establishing the existence of moments 
of t. In Section 2.2 we define the model in a formal way and introduce 
some more notation. In Section 2.3 we define a fluid model related to our 
queueing system and prove various technical facts related to it. Then, in 
Section 2.4 we prove part (i), in Section 2.5 we prove parts (ii) and (iii), and 
in Section 2.6 we prove part (iv) of Theorem 1.1. 

2.1. Some preliminary facts. In this section we establish some technical 
facts needed in the course of the proof of Theorem 1.1. 

Let 0i, 02, ©3, ... be an i.i.d. sequence of nonnegative random matrices, 
and define for any s > 

(2.1) k e (s) = lim o (E||e n ...ei|| s ) 1 / n . 

The following result will be important in the course of the proof of Theo- 
rem 1.1. For the scalar case, related results can be found in [4, 10], and the 
recent paper [8] deals with the matrix case. In fact, the above mentioned 
papers contain some deep results on the distribution of the random matrix 
(or variable) A below; since the proof of Lemma 2.1 is short and elementary, 
we nevertheless include it to keep the paper self-contained. 
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Lemma 2.1. Abbreviate A = ©i + 2 ©i + @ 3 2 ©i H ■ Then: 

(i) if k @ (s) > 1, then E\\A\\ S = oo; 

(ii) if k e (s) < 1, then E||A|| S < oo. 

Proof. The proof of part (i) is straightforward: since the matrices are 
a.s. nonnegative, we have for any n 

E\\A\\ S >E||0 n ...0i|| s . 

If k e (s) > 1, then E||0 n . . . ©i|| s — > oo as n — > oo by (2.1), so (i) is proved. 
Now, we turn to part (ii). Since for any s < 1 



< hT||e n ...e 



\n=l 
oo 



n=l 

in this case the proof immediately follows from the definition of k®(s) as 
well. So, from now on we suppose that s > 1. We use here some technique 
similar to the proof of Theorem 3.1 of [11], adapted to the matrix case. Let 
us recall the following elementary consequence of the Jensen inequality: for 
any real numbers u, v , G, H > and s > 1, we have 

uG + vH fuG s + vH s \ 1 / s 



u+v V u+v 
or, equivalently, 

(2.2) (uG + vH) s <(u + v) s " l (uG s + vH s ). 

Denote A n = ©i + 2 @i H h © n • • ■ @i, and let a n = E||A n || s . Fix any 

a G ((k 6 ^)) 1 / 5 , 1), and apply (2.2) with u = l,v = a n+1 , G = ||A n ||, H = 
a -( Jl + 1 )||e n+ i...0i|| to obtain that 

E||A„ +1 || s <E(||A n ||+a n+1 xa-( n+1 )||0 n+1 ...0 1 ||) s 

(2.3) 

< (1 + a n+l ) s -\E\\A n \\ s + a n+1 Q- s ( n+1 )E||0 n+1 . . . ©J 5 ). 
From the definition of k (s) it follows that 

lim a- s(n+1) E||0 n+1 ...0 1 || s = O 

for any a such that (k®(s)) 1//s < a < 1. Since, trivially, a n = E||A n || s > 
E||0i|| s > for any n, we can conclude that there exists no such that for all 
n>riQ it holds that 

a-(»+i)E||e rH . 1 ...e 1 ||-<a n . 
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So, (2.3) implies that, for all n > no, 

a n+ i < (1 + a n+1 ) s -\a n + a"+V) = (1 + a n+1 ) s a n . 
Thus, for any n, 

(2.4) E||A„|| S <M, 
where 

oo 

M = a no l[ (l + a m+1 ) s <oo. 

m=no 

The proof of part (ii) of Lemma 2.1 for the case s > 1 follows now from (2.4) 
and the monotone convergence theorem. □ 

The next result is very similar to Lemma 2.1, so we only outline its proof. 

Lemma 2.2. Let Xq,Xx,X2, ■ ■ ■ be a sequence of a.s. positive identically 
distributed random variables. Suppose that KXq < oo for a given s > 0. Then, 
for any a > 1, 

, _ ( X\ Xo Xr> \ S 

(2.5) E Io + - + 4 + 4 + - <oo. 

\ a a A or J 

Proof. As before, in the case s < 1 the proof is straightforward. When 
s > 1, the proof can be done quite analogously to the proof of Lemma 2.1(h) 
[use (2.2) with u = 1, v = a"( n+1 ), G = X + a _1 Xi + • • • + a" n X n , # = 
X n+1 }. □ 

The next result is Theorem 1 of [2]: 

Proposition 2.1. Let a be some positive real number. Suppose that we 
are given a {J- ~ n }- adapted stochastic process Z n , n > 0, taking values in an 
unbounded subset of ]R+ . Denote by T a the moment when the process Z n 
enters the set (0,a). Assume that there exist H > 0, po>l such that, for 
any n, is integrable and 

(2.6) nZ P n +l -Z^\F n )<HZ^- 1 

on {T a > n}. Then there exists a positive constant C = C(H,po) such that, 
for all x > whenever Zq = x with probability 1, 



(2.7) 



Et£ <Cx P0 . 
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2.2. Notation and the formal definition of the process. According to the 
description of the process given in Section 1.1, the current state of the system 
can be described by a pair (R,S), where R= (fJ,,j) is the current service 
regime, and S = (N, £o, • • • > £<i) is the current configuration, meaning that the 
server is at station N, and £j is the number of customers at station [JV + i], 
i = 0, . . . , d. To recover the values of N and (£o, ■ • ■ , £d) from S, we use the 
notation M(S) = N and /C(5) = (£ , ...,&)• 

Denote by <p m the operation of the cyclic shift by m positions, that is, 
<Pm(zo, ■ ■ ■ > x d) = (x m , ■ • ■ , Xd, xq, . . . , x m -i), and let e& be the fcth unit vector, 
that is, efc = (0, . . . , 0, 1, 0, . . . , 0) with 1 on kth position, k = 0, . . . , d. The 
transition rates are then described as follows [the current regime is 

• (TV, f ) -> (JV, £ + e.j) with rate A[jv+;] , i = 0, . . . , d; 

• if £o > 2, then 

- (iV, £) -> (iV, £ - e + e») with rate ^7$; 

- (iV,£)^(i\T,£-e ) with rate m(1~7i 7d); 

• suppose that £ = (1, 0, . . . , 0, . . . , with > 1. Then 

- (N, £) — ► ([JV + fc], — eo + ej)) with rate /X7j for i > k, and the new 
regime is chosen independently according to V[N+k] '1 

- (N, £) — > ([iV + i], (fi(t; — eo + ej)) with rate /X7j for i < k, and the new 
regime is chosen independently according to V[n+{\ \ 

- (iV,£) -> ([iV + fe],¥»fc(£ - e )) with rate /i(l - 71 7 d ), and the 

new regime is chosen independently according to lAjv+fcl! 

• (iV,l,0,...,0)^(6,0,...,0) with rate //(l- 71 7d ); 

• (6, 0, . . . , 0) — > (n, 1, 0, . . . , 0) with rate A n , n = 0, . . . , d. 

We refer to the state of the process at time t as (R(t), S(t)). Recall that 
we suppose that the process starts from some nonzero configuration [zero 
configuration is (G, 0, . . . , 0)], and r is the time of reaching the zero config- 
uration, that is, 

r = mf{t >0:Af(S(t)) = 6}. 

For definiteness, we suppose that the trajectories are right-continuous and 
Af(S(0)) = 0. Now, we need to define the sequence of times when the server 
jumps. Put t' := 0, and 

t' n+1 = M{t>t' n :M(S(t))^M(S(t' n ))} 

for all n > 0. Define also, for n such that t' n < r, 

k^ = [N{S{t' n ))-N{S{t' n ^))l 

n > 1, and k^ := 0. Then, define do = t' Q = 0, and o~i = t' n for all i such that 

fc(o) _) 1_ }~(n—i) < -j < -) 1- k( n ) . This means that if the server jumps, 

say, from i to [i -+- k] (i.e., it empties the queue in station i and there are 
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no customers in [i + 1], . . . , [i + k — 1]), then we visualize this jump as an 
instantaneous sequence of k jumps. This approach has the advantage that 
now we can write 

(2.8) M(S(a n )) = [n] 

for all n such that a n < r. 

Since we choose the regimes independently of the past evolution of the 
process, one also can use the following construction. Let 1Z = (Ro,R\,R2, ■ ■■) 
be a sequence of independent .M-valued random variables, R{ ~ z^u. We can 
first fix a realization of this sequence, and then start the process, and the 
regimes will be chosen in the following way. Suppose that the initial con- 
figuration is 5(0) 7^ 0; then take R(0) = Rj^(s(o)) [i n most cases we sup- 
pose that 7V(5(0)) = 0]. Inductively, if R(t) = R4 for t 6 [t' n ,t' n+1 ), then 
R(t' n+l ) = R i+k ( n +i). Note that, analogously to (2.8) when the server uses 
the regime R{, it is in the station [i] (at least before r; it is quite easy to 
modify this construction so that the last statement would be valid for all t, 
but we really do not need that for the purposes of Theorem 1.1). 

In what follows, we use symbols P-# and E-^. to denote probability and 
expectation given the sequence of regimes 1Z. 

2.3. Random fluid model and its relationship with the original process. 
Now, we define what we call the random fluid model. Here we suppose 
that A's and \i are flow rates, that is, the liquid comes to node n with 
speed X n , and when the server is in station k with service rate and feedback 
parameters (fM, j), it sends the liquid from k out of the system with speed 

fj,(l — 71 — 7^), and to each site [k + j] with speed /ry^, j = 1, . . . ,d. In 

other words, the randomness present in this model only relates to the fact 
that, when arriving to a node, the server chooses the serving and transition 
parameters (i.e., the speeds of the corresponding flows) at random. 

We will refer to (R? (t), (t)) as the state of the random fluid model at 
time t [where, as before, 5^(i) is the configuration and R^{t) is the regime]. 
If for a state (R f ,S f ) the regime is R? = (/i,7) and the configuration is 

= (N, xo, • • • , Xd), then we define by 

the time that the server needs to pump all the liquid out of the (current) 
station N. 

To define the fluid model starting from 5^(0) = (N,Xq, . . . ,x®) (as men- 
tioned before, normally we will take N = 0), where x[J > 0, and with the 
initial regime Rf(0) = (^,7), put 

S f (t) = (N,x° -(fi-X N )t, 

x\ + (M7i + -V+i])t, ...,x° d + (nj d + X[ N+d ])t), 
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and Rf(t) = Rf(0) for t<a f N+1 :=%(Rf(0),S f (0)) = x^/(fi-X N ).Fort = a f N+v 
choose Rf{pf N+1 ) ~ v\n+i] independently, and put 

sf (°N+i) = {[N + l],x° 1 + (// 7l + X [N+1] )a f N+1 , . . . , 

x d + (M7d + \n+<H )°n + \ , 0) • 

Inductively, suppose that for some i > N the server switching time a{ is 
defined, and the current configuration is S^(a{ ) = ([i], x z , . . . , x l d _ 1: 0) (note 
that the last coordinate is because the server has just emptied the sta- 
tion and jumped, and that Af(S^ (a{)) always equals [i] since, for the fluid 
model, the server can never jump over a station). Then, choose R^(a{) ~ 
uw\ independently, and supposing that Rf (a{) = (//,7'), put o~{ +1 = a{ + 
1(Rf(a{),Sf(a{)), for t G [a{ ,a{ +l ) define Rf \t) = Rt (a{): 

S'(i) = ([*], 4 -(//-A w )t, 

x\ + (// / 7i + A [i+ i])t,...,^ + (/i / 7d + A [ i + i ] )t), 
and [abbreviating for the moment % := %(R^(a{ ),S^(a{ ))] 

^KCi) = ([i + l],x\ + (mVi + • • • ,4 + UVd + A [i+1] )X,0). 

Let Sf(a{ +1 ) :=([£ + 1], Xq +1 , . . . , 0). At this point it is important to 
note that, denoting by x l (resp., x l+1 ) the column vector with coordinates x l j 
(resp., a^} +1 ), j = 0, . . . , d — 1, we have 

(2.9) x i+1 = i(i)4 

where .A(z) is the matrix defined in (1.1), with (//, V) instead of (/i,7) [i.e., 
j4(«) depends on the current regime]. Letting k= [i], (/i',7') was sampled 
from and j4(z) is a random matrix distributed like A^ k > of (1.1). 

An important technical fact is that, for the fluid model, at the moments a{ 
of server's transition, the relative difference between the amounts of liquid 
in the stations (not counting the station that the server just left) cannot 
become too large: 

Lemma 2.3. Suppose that the initial configuration S^(0) = (N, Xq, . . . , x d ) 
is such that x® ^ for all k = 0, .. .,d — 1. Then there exists a constant 
Ke (0,oc), depending only on eq,Mq (from Condition 1.1), Xk's, d, such 
that a.s. for all i > d, 

(2.10) ~r^ K for alln,m = 0,...,d-l. 
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Proof. Denote A = min{Ao, . . . , A^} > 0, A = max{Ao, . . . , A^}, and sup- 
pose without restriction of generality that N = 0. Let h = J2i=o x i be the 
total amount of liquid present in the fluid system at time 0. Note that, since 
we aim for a constant K that does not depend on the initial configuration, 
to prove this lemma, it is enough to show that there is K such that 

(2.11) m^ 1 ,...,^} ^ 

First, we will give a lower bound on min{a;g +1 , . . . Note that, ac- 

cording to Condition 1.1, each station is emptied with speed at most Mq, a.s. 
Clearly, max{xQ +1 , . . . , x^ 1 } > h/(d + 1), and suppose that this maximum 
is reached in station rh. Then, the time it takes to empty the mth station 
< jZ(Rf(af h ),Sf(af h )) is at least ^ d+ ^ Mo (since the amount of liquid in rh will 
not decrease by the time the server gets there). Therefore, at the moment 
a m+i 0- e -' wn en the server pumps all the liquid out of station rh), we ob- 
tain that all the nonempty stations have at least ^ + ^ A / units of liquid. 
Repeating this argument once again (if d), we obtain that 

(2.12) mM4 »,.,, 4tl} >_^. 

Now, we obtain an upper bound on max{xQ +1 , . . . Again, the key 

observation is that, by Condition 1.1, the speed of emptying the stations 
cannot be less than eq, a.s. Initially, each station (including the one where the 
server starts) has at most h units of liquid. Thus, the time %{W (0), S* (0)) 
to empty the 0th station is at most h/eo, and so at time a( all the stations 
have at most 

h+ <A±D± = h ( 1 + ±±± 



£0 \ 

units of liquid. Repeating this argument d times more, we see that 
(2.13) max{4 +1 , . . . , xj±{} <h(l + 

Using (2.12) and (2.13), we find that (2.11) is verified with 

(l + £ -i(A + l))^+l)M 2 

K = A 2 ' 

and the proof of Lemma 2.3 is finished. □ 

Define a sequence of random variables 

n-l 

D n (SH0)) = 4 = ^ 1{R f {4l S f (a{ )) 

i=0 
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(where <7q := 0), and 

oo 
i=0 

Intuitively, the random variable D^^S^ (0)) can be interpreted as the time 
needed to completely empty the fluid system. Clearly, when Z) oo (S'^(0)) < 
co, the above definition of the fluid model works only when t is less than 
the (random) time Doo(S^(0)). 

Recall that, by Condition 1.1, it holds that 

(2.14) %(Rf(a{),Sf(a{)) € [M^xle^x Q ] 

Also, from Condition 1.1 and (2.9), we obtain that for some positive con- 
stants C\ , C2 and for all k 

(2.15) Ci\\x k \\<\\x k+1 \\<C 2 \\x k \\ a.s. 
Using (2.14) and (2.15), we obtain that for all i > 

£ 1(Rf(a{ +j ),Sf(a{ +j )) < e - Vo + - + x Q +d ) 

3=0 

(2.16) 

<eo 1 Q. + C 2 + — + C$)\\x i \\. 
Analogously, using also Lemma 2.3, we can write for all i > d 

3=0 

(2.17) >M - 1 (xi + --- + xi+ d ) 

> (M Kd)-\l + {Ct/Kd)- 1 + ■■■ + (d/Kdf^l 

Denote A(n) = A(d + n(d + 1)) ...A(l + n(d+ l))A(n(d+ 1)). Clearly, the 
matrices A{n) are i.i.d. and A(n) ^= A. Denote also for all < n < oo 

A n = i(0) + i(l)i(0) + • • • + A(n) . . . 1(0). 
Note the following two properties of the £i-norm: 

• if Bi,B2 are nonnegative matrices and x is a nonnegative vector, then 
H-BixH + ||-B2x|| = \\(B\ + B2)x\\, and 

• if \\ x \\ < 1 an d Xj > c > for all j, then \\Bx\\ < ||S|| < c _1 ||i?x|| for any 
nonnegative matrix B. 
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Taking this into account, from (2.9), (2.16) and (2.17), we obtain that there 
exist Ui,U2 such that 

(2.18) £/i||An-i|| < D n(d+1) (S f (0)) <tf 2 ||A n _i||, 
and so 

(2.19) C/i||Aoc|| < D^S^O)) < l7 2 ||Aoo||. 

Analogously to the stochastic model of Section 2.2, we can first choose the 
sequence of regimes 1Z = (Ro , R\ , R2 , ■ . .) (as before, it is a sequence of inde- 
pendent .M-valued random variables, E4 ~ y [i])- Then, given a realization of 

this sequence, put R^(t) ■= Ri, t € [o~{ ,a{ +1 ), i > M(S^(0)). It is important 
to note that, when 1Z is fixed, the fluid model becomes a completely de- 
terministic process; in particular, the values of D n (S^(0)) and i? oo (S'^(0)) 
can be explicitly calculated. To indicate this, when 7Z is given, we write 
D n (S-F(0) | TV) and Z?oo (S^(0) | 7Z) for those quantities. Also, note that all 
the variables in 1Z [beginning with the J\f(S^ (0))th one] will be used, which 
is not necessarily the case for the stochastic model. 

To prove Theorem 1.1, an important idea is to relate the behavior of 
the stochastic system to that of the fluid model when they share the same 
regimes. In other words, a coupling of these two systems can be performed by 
using the same sequence of regimes 1Z. Consider any nonempty initial config- 
uration 5(0) = S^O) = (n,yo, . . . ,yd) and take any R(0) = Rf(0) = (^,7) € 
suppf n . Let a s = inf{i > 0:M(S(t)) 7^ n} be the time one needs to wait until 
the server's jump for the stochastic model, and let 1(Rf(0), (0)) = ^ 
be the corresponding time for the fluid model. Then, we have the following 
result: 

Lemma 2.4. (i) For any 5 > there exists a constant V\ = V\{5) > 
(depending also on Eq,Mq from Condition 1.1, As, d) such that 

(2.20) ? n [\o- s - T(R f (0),Sf(0))\ < 5y ] > 1 - e~ v ^. 

(ii) Suppose that S(a s ) = ([n + 1], Zq, . . . , zj-i, 0) (here we assume that 
in the initial configuration y\ > 0, otherwise it is not certain that the next 
destination of the server will be [n + 1\) and (1(Rf (0), 5^(0))) = ([n + 
1], z£ , . . . , zi_ 1, 0). Let A be the matrix defined in (1.1), and abbreviate y = 

(yo,---,yd-i) T , z = (z ,...,z d _ 1 ) T , z f = {zl,...,z f d _ l ) J = Ay. Then for any 
5 > there exist V2 = V^(5) > (depending also on e$,Mq from Condition 
1.1, Xk's, d) such that 

(2.21) Pn[\z-zf\<5yo]>l-e- V2 y°. 
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Proof. The proof of this fact is completely elementary, so we give only 
a sketch. 

First, we deal with (2.20). The evolution of the queue in the current sta- 
tion n can be represented as a birth-and-death process X(t) on Z starting 
from yo > 0, with (constant) birth rate X n and death rate [i. Now, the mo- 
ment a s is the time to reach for this process. For the sake of simplicity, 
suppose that ^ + A n = 1, that is, the total jump rate of the process X(t) is 1 
(this can always be done by rescaling the time, and the scaling factor will 
be bounded from both sides by Condition 1.1). Note that 



A, 



<p 


H 







IK) 



+ Sy > 



The number of jumps of X(t) on the time interval [0, 



yo 



least 



yo 



+ 8yo] will be at 

— h with probability at least 1 — e~ ClVo for some C\ > (and 
it is not difficult to see that the constant C\ can be chosen uniformly by 
Condition 1.1). For the corresponding discrete-time random walk X(n), it is 
a straightforward computation to bound P[Jt(- 



yo 



+ 



$yo s 



t- tj > 0] from above 
5yo] from above, we note that, by time — — 
Syo, the continuous-time process X(t) will perform at most 



To bound 



a* < 



yo 



fJ,—\n 



^ jumps 



with probability at least 1 

yo 



H ~ A n 



— e c ' 2yo for some C>2 > 0. So, we write 
Syo 



< J2 P[X(m)<0], 

m <(yo/(M~An))-(5yo/2 



and then again use large deviations estimates to bound the terms in the 
right-hand side of the above display. 

As for (2.21), it follows easily from (2.20) if we take into account the 
following two observations: 

• by (2.20), we have good control on a s (the time it takes to empty the 
queue in n); 

• knowing this time, for alH = 1, . . . , d it is straightforward to estimate how 
many customers will come to station [n-M] during that time (given a s =t, 
the number of customers that came from outside is simply a Poisson ran- 
dom variable with mean A[ n+ ji£); moreover, we can easily write estimates 
on the total number of customers that came out of station n, and then 
observe that the proportion (roughly) ji of them go to [n + □ 



2.4. Transience. Here we prove part (i) of Theorem 1.1, that is, we show 
that if k'(0) > 0, then P[r = oo] > 0. The corresponding result in [11] was es- 
tablished using the Lyapunov function technique, but we provide a different 
argument here. 



POLLING SYSTEMS WITH PARAMETER REGENERATION 19 

The quantity k'(0) > is in fact the top Lyapunov exponent of A, so 
for almost every 1Z there exist a > 1 (not depending on TV) and a positive 
number C\ = C\ (1Z) such that 

(2.22) \\A n . . . A ± \\ > C ia n 

for all n. Note that, since A l = A(i(d + 1) + d) . . . A(i(d + 1)) for all i > 0, 
from (2.22) we obtain that for some C2 

(2.23) \\A(m - 1) . . . A{d + 1) || > C 2 a m/id+1 '> 
for all m > d + 1 . 

Now, the idea is to compare the stochastic model and the fluid model 
which start from the same initial configuration and share the same sequence 
of regimes. 

Consider the stochastic and the fluid model with the same initial config- 
uration: 

5(0) = Sf(0) = (0, Co°, ■ • ■ , 0) = (0, s°, . . . , x°_i, 0), 

and, as before, (£oV--,£d) = ^-(5 , ( <T «))> ( x 0' • • • ' ^d) = ( a i))- Since we 
have Cd = x rf = f° r an 2, let us denote = (£q, • ■ • , Cd-i) T an d 
x* = (xq, • • • , x^_ 1 ) T . Here T means transposed, so and x* are column 
vectors. 

Consider the sequence of events 

B 5 m = {£ m > (1 - 5) m x m }, 

m > 1. From (2.9) and (2.23) we obtain that 

\\ x m \\ = \\A(m - l)I(m - 2) . . . A{d + l)x d+l 1| 

> C 3 ||I(m - l)l(m - 2) . . . 1)||, 

so, by Lemma 2.3, we have that xff > C A a m ^ d+1 ^ for some C4 > 0. With 
this fact, we recall Lemma 2.4(h), and write for n > d + 1 

> P[f > (1 - <5) n_1 I(ra - l)/^ 1 I = (1 - <5) n ~ 1 x n " 1 ] 

(2.24) 

^l-expl-^^a-^x^^ 1 } 

> 1 - exp{-y 2 (<5)(l - 5) n - 1 C 4 a (n_1)/(a!+1) }. 

Choose <5 > in such a way that (1 - 5)a l ^ d+l "> > 1. It is clear that Pn[Bf] > 
and Pn[B S k | . . . , B 5 X ) > for all k < d + 1, so, by (2.24), it follows 

that P^n^i &n] > °- Since 011 {fl£Li B 5 n } we know that > (1 - 5) n C 4 x 

a n/(d+l) _^ 

it holds that r = 00 with positive probability for almost ev- 
ery 1Z. This proves the transience result. 
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2.5. Recurrence and existence of moments. First, note that if k'(0) < 0, 
then so > 0, and that if Er s < oo for at least one s > 0, then P[t = oo] = 0, so 
part (ii) of Theorem 1.1 easily follows from part (iii). Thus, we concentrate 
on part (iii). 

Fix s such that k(s) < 1 (or, equivalently, s < sq). For the stochastic 
process S(t) define a sequence of stopping times £ n , n = 0,1,2, ... , via £q := 
0, 

£ n+1 = mf{t>£ n :S(t)^S(£ n )} 

for n > 0. The time £ n is the nth jump time of S(t), that is, a customer 
arrives at the system or a service is completed. 

Given the sequence of regimes ft, the process S(n) := S(£ n ) is a discrete- 
time Markov chain (however, in general it need not be time-homogeneous). 
If the current regime is (^1,7), then if S(n) = (N,£) with £0 > 1 (it is easy 
also to treat the case £0 = 1 analogously to what was done in the beginning 
of Section 2.2 for continuous time), then 

f(N,£ + &i) with probability Z~ l \y N+i -\, 
(N, £ - e + ei) with probability Z' 1 ^, 
(N, £ — eo) with probability Z~ x ^l{\ — 71 — 7^), 

where Z = « + Ao + • • • + A^. 

For a configuration S = (N, £) and a sequence of regimes ft define f^(S) 
to be the time it takes for the fluid model to arrive at starting from S: 

/*(5) = 1)00(5 I ft). 

We need the following: 

Lemma 2.5. There exists £ > such that for all n and for all possible 
regimes 

(2.25) Efc(/*(5(n + 1)) - f n (S(n)) \ S{n) = S,M(S) ± &) < -£. 

Proof. First of all, it is not difficult to obtain that f^(N,x) is a linear 
function of x. Then, if (/x,7) is the current regime, write, abbreviating as 
before Z = u + Ao + • • • + A<2, 

E n (f n (S(n + l))\S(n) = (N,x)) 

d d 

= Z~ l \N+i]f n (N, x + ei ) + Z~ V E 7i/*W s " eo + <*) 

i=0 i=l 

(2.26) 

+ Z~V(l-7i -y d )f K (N,x-eo) 

= f*'(N,x + y), 
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where 

y = z ~ l \ y_] -V+il e i + ^y]li(ei ~ eo) -A*(l-7i ld)e 



(2.27) 



\i=0 i=l 



If the fluid model is now in (N, x) with regime (/z, 7), then in Z 1 time units 
it will be in (A, x + y), so 

E^(/ K (5(n + 1)) - f n {S{n)) \ S(n) = S,Af(S) + 6) = < -e, 

where e = (Ao H h X& + Mo) -1 (recall that Mq is from Condition 1.1). □ 

From Theorem 2.1.1 of [6] we obtain that (remember that r corresponds 
to the continuous-time process, and the total jump rate is bounded from 
below by Ao + • • • + A^) 

(2.28) E n r < r\X + ■■■ + X d )f n (S(0)), 
and, by the Jensen inequality, 

(2.29) E n r s < £- s (X + ■■■ + X d ) s (f n (S(0W , 

for any s < 1. We can use (2.19) and Lemma 2.1 to get that Er s < 00 when 
k(s) < 1 (for the case s < 1). 

Now, the goal is to obtain an analog of (2.29) for s > 1. 

The idea is to use Proposition 2.1. For that, it would be nice to have a 
constant C such that 

(2.30) \f n (S(n + l))-f n (S(n))\<C, a.s. 

For a fixed 1Z such C exists [take C = /^(0, eo + • • • + e^)], but it is not 
uniform, which prevents us from getting an analog of (2.29) (with a constant 
that does not depend on 7V.) directly from Proposition 2.1. 

To get around this difficulty, let us proceed in the following way. We 
consider another function /J^(-), which is the time of reaching the origin 
for a slightly modified fluid model that dominates the original one. For this 
new function, when the maximal one-step increment is large [cf. (2.30)], it 
happens also that the drift in the negative direction is large as well, and 
that permits us to apply Proposition 2.1. 

Fix e > and consider a modification of the present model, where the new 
arrival rates are A£ = Xi + e, i = 0, . . . , d. As in Section 2.3, define (S \ TV) 
to be the total time needed to completely empty the fluid system with A^'s 
in the place of Aj's, starting with S and when the sequence of regimes TZ is 
fixed. And, denote f^(S) := D&(S \ TV). 
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Analogously to (2.26), we can write (here E-ji is the same as before, i.e. 
it is related to the process with Aj's, and not A^'s) 

E w (/f (S(n + 1)) | S(n) = (N, x)) = f?{N, x + y) 

= f?(N,x + y 1 )-eF$, 

where y is from (2.27), 

d 

yi 



( N 

1 J2( X '[N+i] + M7i) e i - - A Af) e o 

\i=l / 



= y + eZ 1 (e -\ Ve d ), 

andF? :=fK(N,eo + --- + e d ). So, 

E^(/f (S(„ + 1)) | S(n) = (N , x)) = -iT 1 - eiT 1 ^ 

(2.31) 

< -eZ^F^, 

where = minjv=o ... d Fn ■ Also, from Condition 1.1 and Lemma 2.3 it is 
not difficult to show that [compare with (2.30)] there exists C\ such that 

\f?(S(n + 1)) - f?(S(n))\ < dF®, a.s. 

Again, using Condition 1.1 and Lemma 2.3, it is straightforward to obtain 
that there exists C2 such that, on S(n) = (N,x) 

Abbreviate Z n := f*(S(n)). Using some elementary calculus, we see that 
for any C4 > there exists C3 > (depending on s) such that 

{l + y) s <l + sy + C 3 y 2 on {y G R : \y\ < C 4 }. 

So, by (2.31) and (2.32), if x is such that < C 4 , 

E w (Z^. 1 -^|S(n) = (JV,x)) 

= (/* (J\r,s))-4s*((l + Zn+1 z ~ Zn ) S ~ 1 J S(n) = (iV,x)) 

< (/f (Af,x)) s - 1 [ S E^(Z n+1 - Z n I S(n) = (iV,x)) 

+ C 3 (f?(N, x))" 1 E^((Z n+1 - Z n ) 2 I S(n) = (N, x))] 

(F( £ )) 2 



< (f^x))"- 1 -sZ- l eF^ + C 3 Cl 



x\\f?(N,x/\\x\ 
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By Condition 1.1 and Lemma 2.3, there exist C5, Cq > such that > C5 
and jjiqjj ^ < Cq for any e such that ||e|| = 1. So, we obtain that there exists 
01 such that 

E n (Z^ +1 - Z s n I S{n) = (N, x)) < (J?(N, x^F^ (-sZ~ l e + ^pp) 

for x such that ||x|| > a\. From Proposition 2.1, we obtain that there exists 
C$ > (depending also on s) such that 

(2.33) E^T s <C 8 (/f(S(0))r, 
for s > 1. 

Now, for any 5 > we can find e > such that 

(2.34) if (5(0)) =flW(S(0) I ft) < ||AW||||S(0)||, 
where 

AW = (l + «j)i(o) + (1 + ,5) 2 i(l)i(0) + (1 + <5) 3 i(2)i(l)i(0) + • • • . 

Choose (5 in such a way that (1 + 5)k(s) < 1, and use (2.34) and Lemma 2.1 
to obtain that 

E(r(ai)) s < 00, 

where r{a\) is the moment of hitting the set {x : ||x|| < ai} for the discrete- 
time process. Then, by a standard argument (see, e.g., Theorem A.l from [13]), 
we get that, for the discrete-time process, the sth moment of the hitting time 
of © is finite, and so Er s < 00. □ 

2.6. Nonexistence of moments. In this section we prove part (iv) of The- 
orem 1.1. We have to prove that if s > so [equivalently, k(s) > 1], then 
Kt s = 00. 

The strategy of the proof is the following: 

1. We consider the fluid model and we note first that, by Lemma 2.1, the 
expectation of the sth moment of the random variable is infinite. 

2. We consider a smaller random time, which is the time of reaching some 
"growing" set. Then, with the help of Lemma 2.2, we prove that the sth 
moment of that random time is still infinite. 

3. We look now at the stochastic model when the trajectory of the fluid 
model is fixed (i.e., with a fixed sequence of regimes TZ). Then, we prove 
that with a constant probability the time of reaching that finite set for 
the stochastic process will be greater than the corresponding time for the 
fluid model. 
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4. This fact permits us to obtain that, given TZ, the sth moment of the time 
of reaching for the stochastic process is (roughly) proportional to the 
corresponding time for the fluid model (which is deterministic, since TZ 
is fixed). 

5. Then, we integrate and, using Lemma 2.1, conclude that Er s = oo. 

Let rit = max{i : a{ < t}. Define, for some constants 5, K to be chosen 



later 
(2.35) 



T(x° 1 TZ)=ml\t:\\)C(S f (t))\\ < 



\x°\\(l + 5) 
K 



in 



where W(0)) = x°. First, our goal is to prove that E(T(x° ,TZ)) S = oo if K 
is large and 5 is small enough. 

From (2.9), Condition 1.1 and Lemma 2.3, we obtain that, for some C\ 

(2.36) T(x°, TZ) > d ||(I(0) + 1(1)1(0) + • • • + A(U) . . . i(0))x°||, 

where 



(2.37) 



U = min< k 



A(k) A(0)_ x0 



< 



K 



1 + 5) (1 + 5) 
Denote for any a > 

T a (R)= inf T(x,K), f a {lZ)= sup T(x,U). 



x:\\x\\=a 



x:\\x\\=a 



Using Condition 1.1 and Lemma 2.3, we obtain that there exists C2 > such 
that 



(2.38) 



T a (TZ) 



T a (TZ) 

for any a and TZ. By (2.36) and Lemma 2.3, 



T(x°,K) > Ci 
>C 3 



A(0) | A(l)A(0) | | A(U)...A(0) y r0 



1 + 5) ' (1 + 5) 2 
A(0) , 1(1)1(0) 



+ 



(1 + 5) (1 + 8) 2 



+ ■■■ + 



(l + 5) u J' 

A(U)...A(0) 



(l + S) 



u 



for some C3. 

If K is large enough, then there exist 1 < K' < K and C4 such that 



(2.39) 



T a (1Z) > C 4 a 



A(0) 



| A(1)A(0) | | A(U')...A(0) 



(l + 6)d+i (l + ( J)2(rf+l) 



( 1 + S)U'(d+i) 
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A(k)...A(0) _ 1 
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(2.40) 



U = min< k : 



(l + ( 5)fc(rf+i) 



< 



K> 



Abbreviate b= \\x°\\. Using (2.38) and (2.40), one can write 
1(0) 



A(1)A(0) A(2)A(1)A(0) 
(1 + (J)^ 1 (1 + 5)2(d+l) (1 + (J) 3 ^ 1 ) 



< 



1(0) 



(1 + S)^ 1 



+ ••• + 



!([/')... 1(0) 



(1 + S)U'(d+l) 



+ 



A' 



A(U' + l)A(U')...A(p) 



(l + $)(U'+i)(d+i) 



+ 



Continuing in this way and using (2.39), we can write 
1(0) 



, -4(1)^(0) A(2)A(1)A(0) 

(i + <y)^+i (i + <5)2(d+i) (! + (5)3(d+i) 



OO 7 



where Zi, i = 1,2,3, ... , are independent copies of When k(s) > 1 and 5 
is small enough to ensure that (1 + (5)~ 1 k(s) > 1, Lemma 2.1 implies that 
[use @ k = (1 + 5)~ 1 A(k), so that k e (s) = (1 + $) -1 k(a)] 



E 



1(0) 



| A(1)A(0) ^ | A(2)A(1)A(0) 



(1 + 5Y+ 1 + (1 + 5)3(^+1) 

and so, by Lemma 2.2, E\I/ & = oo. Prom (2.39), we obtain that 
(2.41) E(T{x°,K)) s = oo. 

Let [recall (2.35)] n = ^t(x°,7J)- Denote 

s n = {||/c(5K))||>(i-0||x:(5/(^) 



oo, 



and 



b = n s ? , 



n=l 



From part (ii) of Lemma 2.4 we obtain that for n < k 

(2.42) P n [B n \B n ^ 1 ,...,B 1 ]>l-exp{-C G \\]C(S f (af l ))\\} 

for some C 6 > 0. By the definition (2.35) of T(x°,TZ), 

M*Vj)ii>M&±£ 



A' 
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so (2.42) implies that 

p^]>n(i- e -^ i+5 n>o. 

n=l 

Now, on B we have that r > T(x°,lZ), so Eht s > C8(T(x°, 7£)) s for some 
positive constant GV Using (2.41), we obtain that 

Et s >C 8 E(T(x°,^)) s = oo. 
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